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PROBLEM TO BE SOLVED: To intensify a stereoscopic 
effect or engrossment. 

SOLUTION: This device is constituted of a screen 1 
whose concave surface faces to a person who is to be 
experienced, which is spherical and whose angle of 
visibility is wide, a video forming means 2 forming an 
interactive stereoscopic video, a distortion correction 
means 3 for previously distorting the video so that the 
distortion may be eliminated when the video is displayed 
on the screen 1 , a projection means 4 for projecting the 
stereoscopic video whose distortion is corrected on the 
screen 1 , and stereoscopic vision spectacles 5 for 
enabling the person who is to be experienced to 
stereoscopically view the video projected on the screen 
1. It is desirable to plurally provided the projection 
means 4 and to perform such correction that the 
boundary lines of plural videos divided and projected on 
the screen 1 by the respective projection means 4 are 
aligned. It is desirable to set the angle of visibility of the 
screen 1 is nearly the same as that of a human being. 



MllM!>tt7«l 



I 



"7 — 



a.^^^»^ I 



7 



LEGAL STATUS 

[Date of request for examination] 

[Date of sending the examiner's decision of 
rejection] 



http://www1 9.ipdi.ncipi.go.jp/PA1 /result/detail/main/wAAAsYaGVFDA41 231 0826P 2005/03/1 0 



Searching PAJ 



2/2 ^— V 




[Kind of final disposal of appncation other than 
the examiner's decision of rejection or 
application converted registration] 

[Date of final disposal for application] 

[Patent number] 

[Date of registration] 

[Number of appeal against examiner's decision 
of rejection] 

[Date of requesting appeal against examiner's 
decision of rejection] 

[Date of extinction of right] 



Copyright (C); 1998.2003 Japan Patent Office 



http://www19.ipdl.ncipi.gojp/PA1/result/detail/main/wAAAsYaGVFDA412310826f... 2005/03/10 



2000-310826 



[Claim(s)] 

[Claim 1] An image creation means to create the screen of a wide-field-of-view angle, and 
interactive 3-dimensional scenography by the shape of the spherical surface which turned the 
concave surface to the experience person. The distortion amendment means for making an 
image beforehand distorted so that distortion may be lost, when displayed on a screen. The 
virtual environment experience display characterized by an experience person consisting of 
stereoscopic vision glasses of a **** sake in three dimensions in the projection means for 
projecting to a screen the 3 -dimensional scenography by which distortion amendment was 
carried out, and the image projected on the screen, 

[Claim 2] It is the virtual environment experience display according to claim 1 characterized by 
said distortion amendment means performing amendment whose boundary line of two or more 
images by which division projection was carried out with each projection means at the screen 
corresponds by making said projection means into plurality. 

[Claim 3] The angle of visibility of said screen is a virtual environment experience display 
according to claim 1 or 2 characterized by making it comparable as human being's angle of 
visibility. 

[Claim 4] It is the virtual environment experience display according to claim 1, 2, or 3 
characterized by forming the emitter machine which sends the remote control signal for said 
stereoscopic vision glasses being equipped with the liquid crystal shutter of the pair of a wrap 
sake for the eye of right and left of an experience person by turns, and said image creation 
means having the means which changes an outstanding image at high speed by turns by the eye 
on either side, and changing said liquid crystal shutter synchronizing with the image of said 
image creation means. 

[Claim 5] The virtual environment experience display according to claim 2 characterized by 
arranging two or more projection means at the abbreviation equal distance from the core of a 
spherical-surface-like screen. 

[Claim 6] The virtual environment experience display according to claim 1, 2, or 3 characterized 
by making the image of a wide-field-of-view angle project on the screen on the spherical 
surface by once reflecting the image projected from two or more projection means in a convex 
mirror. 

[Claim 7] Claims 1, 2, and 3 characterized by to have the function of performing the always 
optimal amendment by arranging the camera for location detection of an experience person 
above experience equipment, and the image photoed with this camera detecting an experience 
person's location, and changing the parameter of distortion amendment dynamically to an 
experience person's detected location, or a virtual-environment experience display given in 
either of 6. 
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[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the virtual environment experience display 

which can experience virtual environment by 3-dimensional scenography. 

[0002] 

[Description of the Prior Art] Since a cubic effect can be acquired if the image for a right eye 
and left eyes is displayed only on each corresponding eye as the creation approach of 
3-dimensional scenography, there is an example of solid graphic display by the anaglyph 
method which used the cellophane glasses of **** in ancient times etc. Although solid graphic 
display can also realize the display on a television screen, if there are few fields in which an 
image is reflected, in order to spoil a cubic effect remarkably, the bigger one of a graphic 
display screen is effective. For this reason, in the expo (the Tsukuba exposition, Osaka 
exposition), 3-dimensional scenography was displayed on the hundreds of inches huge flat 
screen. Moreover, on the plane screen, since unreasonableness produced the periphery on the 
image, the semi-sphere-like screen also appeared (IMAX). However, the image which photoed 
all on the film beforehand is displayed, and there is no interactive nature for experiencing 
virtual environment. 

[0003] There are some which displayed the image created by computer on real time on the 
screen as solid graphic display with interactive nature, it considers as the example which 
combined two or more the screens further, and there are an arch mold screen (3rd page), CAVE 
(5th page), etc. Since the distance from a projection means becomes large and problems, such as 
distortion and an irregular color, arise so that it becomes perpendicularly in the upper part of a 
screen, he is trying to cover one half extent of an experience person's angle of visibility, 
although an arch mold screen is a cylindrical shape-like screen and can realize the 
wide-field-of-view angle of 180 degrees or more as a horizontal angle of visibility. Furthermore, 
since there is no distortion amendment function as a creation means of an image and image 
projection by the image creation approach to a flat-surface configuration was performed, it was 
regarded as the false flat screen and the distorsion of projected image of a periphery had spoiled 
a feeling of devotion, and a cubic effect. Although it is the display means which CAVE uses the 
5th page of a cube mold as a screen, and encloses an experience person and a high cubic effect 
and a feeling of devotion can be obtained, since a configuration is a cube, there is a fault 
resulting from the geometric configuration of spoiling a continuity in the knot of a screen. 
Although CAVE has a display amendment function for making the display between screens 
continue, it is difficult to connect an image smoothly in the interface of each screen side, and the 
phenomenon which can bend and be seen only by a view location shifting slightly in an 
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interface appears. 
[0004] 

[Problem(s) to be Solved by the Invention] An experience person can sense a deep feeling of 
devotion which entered the world displayed completely by covering an experience person's 
visual field with an image, and performing a display and its exact scale display of the 
3-dimensional scenography of high resolution. Although it is an ideal to cover this whole visual 
field with an image since it is reported at the maximum physiologically that people's angles of 
visibility are 210 horizontal directions and about 110 perpendicular directions, implementation 
with the screen of a flat-surface configuration is impossible. Then, a screen side is bent and it 
must be made to have to surround an experience person. The configuration of such an ideal is a 
globular form. 

[0005] Although creation of real time and an interactive image is based on a computer, the 
image of a computer is usually created by the flat-surface configuration. If this image is 
displayed on a globular form screen as it is, it will become the perverted image as shown in 
drawing 2 (a). For this reason, when it displays on a globular form screen, it is necessary to 
make the image by the computer beforehand distorted, as shown in drawing 2 (b) so that 
distortion may be lost. This is called a distortion amendment function. 

[0006] If it displays by one more set of a projection means, since an image is expanded, both the 
resolution of an image and brightness will fall. Although high resolution and high brightness can 
be maintained by using two or more projection means, image creation with which the image 
into which only the number of projection means was divided in this case is created, and the 
boundary part of each image at the time of composition is connected further smoothly is 
required. 

[0007] This invention is made in view of such a point, and the place made into the purpose is to 
realize the virtual environment experience display which can improve a cubic effect and a 
feeling of devotion greatly. 
[0008] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem 
according to invention of claim 1, as shown in drawing 1 An image creation means 2 to create 
the screen 1 of a wide-field-of-view angle, and interactive 3-dimensional scenography by the 
shape of the spherical surface which turned the concave surface to the experience person, The 
distortion amendment means 3 for making an image beforehand distorted so that distortion may 
be lost, when displayed on a screen 1, It is characterized by an experience person consisting of 
stereoscopic vision glasses 5 of a **** sake in three dimensions in the projection means 4 for 
projecting the 3-dimensional scenography by which distortion amendment was carried out to a 
screen 1, and the image projected on the screen 1. 
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[0009] It is desirable to perform amendment whose boundary line of two or more images which 
made the projection means 4 plurality, divided into the screen with each projection means 4 here, 
and were projected corresponds (claim 2). In this case, it is desirable to arrange two or more 
projection means 4 at the abbreviation equal distance from the core of the spherical-surface-like 
screen 1 (claim 5). 

[0010] It is desirable to make the angle of visibility of a screen 1 comparable as human being's 
angle of visibility (claim 3). Moreover, it is desirable to form the emitter machine 6 which sends 
the signal for the stereoscopic vision glasses 5 being equipped with a wrap liquid crystal shutter 
for the eye of right and left of an experience person, respectively, and carrying out remote 
control of this liquid crystal shutter from the image creation means 2 (claim 4). 
[0011] Moreover, when it is that to which the projector to be used generally cannot realize the 
field angle needed for the display of this invention from a price being high, the projector which 
can realize an extensive field angle places a convex mirror on the optical path, and forms an 
image into an extensive field angle (claim 6). In this case, if distortion amendment is 
indispensable and there is no distortion amendment, an experience person will catch sight of the 
image distorted extremely. However, if there is a distortion amendment function which was 
described by claim 1 of this invention, it is possible to show an experience person a natural 
image. 

[0012] Strict amendment cannot be performed, if the information where the view which the 
experience person is looking at is is not used when performing distortion amendment. Then, a 
means to measure an experience person's location is needed. In order to detect an experience 
person's location, it is conunon to use an electromagnetic-induction mold or the sensor of 
ultrasonic use, but each of these does not have good operability in order to require an experience 
person to equip with a sensor. Then, if the image from an experience person's upper part is 
photoed using a CCD camera, an experience person's location is computed by difference with an 
image in case there are not this and an experience person and distortion amendment of an image 
is performed using an experience person's positional information searched for as described to 
claim 7, it will become possible to attain the above-mentioned purpose, without giving an 
experience person a special sensor. 
[0013] 

[Embodiment of the Invention] The whole virtual environment experience display configuration 
of this invention is shown in drawing 1 . In drawing 1 , as shown in drawing 3 and drawing 4 , a 
screen 1 is a wide-field-of-view angle screen of the shape of the spherical surface which has 
curvature also perpendicularly also horizontally, and the image of a wide-field-of-view angle is 
indicated by projection with the projection means 4 which consists of six sets of projectors. The 
image creation means 2 consists of a graphics computer, and creates interactive 3-dimensional 
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scenography on real time. The distortion amendment means 3 is software with the distortion 
amendment function on a computer, and gives distortion beforehand to an image like drawing 2 
(b) to the image created with the image creation means 2. Moreover, it has the distortion 
amendment function in which the knot of each image is connected smoothly so that one whole 
image may only consist of not only the amendment to the spherical surface but six separate 
screens. The video signal from each screen is passed to six sets of projectors, respectively, and 
an image is displayed on the spherical-surface-like wide-field-of-view angle screen 1. 
[0014] With the image creation means 2, in order to display 3-dimensionaI scenography, a 
graphics computer is used and an image on either side is created separately. What is necessary is 
just to display an image on either side on each eye, as the Prior art described in order to see this 
in three dimensions. Then, the image of the right and left created by computer is changed and 
expressed as a high speed to the extent that people cannot recognize. And when the liquid 
crystal shutter of right and left at a high speed is changed from a computer to the stereoscopic 
vision glasses 5 with delivery and the stereoscopic vision glasses 5 with infrared radiation 
synchronizing with an image and the image of a right eye is reflected in the synchronizing 
signal for 3-dimensional scenography for changing, a left eye is hidden, and when the image of 
a left eye is reflected, it is made to operate so that a right eye may be hidden. In addition, in 
order to send the control signal of a liquid crystal shutter to the stereoscopic vision glasses 5 
from a computer, two or more infrared emitter machines 6 are arranged near the experience 
person. 

[0015] Furthermore, since it is created by real time, an image can be moved interactively. 
Control of this motion is operated with the actuation means 7, such as a joy stick, to a mouse, a 
keyboard, and a pan. Thereby, an experience person can experience virtual environment from 
various views, moving freely in the displayed virtual environment. Moreover, as shown in 
drawing 4 , the screen 1 is huge compared with the experience person M, and since the pendant 
of the projection means 4 is carried out by the supporter material 8 from head lining so that the 
experience person's M field of view may not be barred, two or more experience persons can 
experience virtual environment to coincidence, for example, it can use for a plan and design of 
urban development or disaster prevention planning. 

[0016] About the distortion amendment function, conventionally, although there is an example 
realized by optical processing which used the fish-eye lens etc., by this function, it is realized on 
software. The predominance is described. When a lens realizes a distortion amendment function, 
the lens which suited the display system beforehand is created, the lens must be used, and an 
image must be created and displayed. For this reason, when the magnitude and the form of a 
display system change, it cannot respond. On the other hand, if software realizes a distortion 
amendment function, it can respond only by the parameter setup doubled with the display 
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system. Moreover, the trouble of the resolution and the brightness of an image which are 
displayed when [ large ] a wrap is large falling an experience person's visual field in inverse 
proportion to the screen product, and it becoming impossible for an image to give an experience 
person the cubic effect and the feeling of devotion which are the original purpose arises in one 
set of a projection means. Although amendment for connecting smoothly the display by two or 
more projection means can be performed and it is possible like an example to constitute an 
image from six fields when the distortion amendment function by software is used, it is 
impossible to connect each image smoothly in the display by optical system. 
[0017] The principle which realizes a distortion amendment function by software is as being 
shown in drawing 5 . By present computer, all images are created on a flat surface. Then, an 
image is once created on a flat surface and it sticks on the spherical-surface configuration 
doubled with the screen, without displaying as it is. This is called mapping processing. 
Processing which furthermore projects it on a flat surface is performed, and it displays as an 
image. That is, a distortion amendment function is realized by performing processing which 
creates an image twice. 

[0018] Drawing 6 and drawing 7 show 1 operation gestalt of invention of claim 6. Drawing 6 is 
drawing which looked at equipment from the top, and drawing 7 is drawing which looked at 
equipment from width. About the screen 1, the horizontal section and the vertical section are 
shown, respectively. The image of a wide-field-of-view angle can be made to project on the 
screen 1 on the spherical surface by placing a convex mirror 9 on the optical path of a projector 
4, as shown in drawing. In the example of drawing 3 and drawing 4 , to having realized the 
image of a wide-field-of-view angle using a total of six sets of projectors 4, this example has 
realized the image of a wide-field-of-view angle at a total of two sets of projectors 4, horizontal 
and when the vertical projection include angle spread. 

[0019] Thus, if distortion amendment stated by drawing 2 and amendment of distortion 
produced in the convex mirror 9 in coincidence are also performed although amendment of the 
distortion accompanying it is indispensable when an image is formed into an extensive field 
angle using a convex mirror 9, it is possible to show an experience person a natural image. Strict 
amendment cannot be performed, if the information where the view which the experience 
person is looking at is is not used when performing distortion amendment. Then, a means to 
measure an experience person's location is needed. In order to detect an experience person's 
location, it is common to use an electromagnetic-induction mold or the sensor of ultrasonic use, 
but each of these does not have good operability in order to require an experience person to 
equip with a sensor. Then, if the image from an experience person's upper part is photoed using 
a CCD camera, an experience person's location is computed by difference with an image in case 
there are not this and an experience person and distortion amendment of an image is performed 
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using an experience person's positional information searched for as described to claim 7, the 
need of giving an experience person a special sensor will be lost. Consequently, distortion 
amendment of the always optimal condition can be performed also to an experience person with 
a motion by inputting the acquired position coordinate into the computer which performs 
distortion amendment, and amending dynamically. 
[0020] 

[Effect of the Invention] the interactive 3-dimensional scenography which performed distortion 
amendment corresponding to the spherical surface according to invention of claim 1 — creating 

— the shape of the spherical surface — the screen top of a wide-field-of-view angle ~ projecting 

— an experience person — stereoscopic vision glasses — **** — since it was made like, it is 
effective in a very high cubic effect and a feeling of devotion being obtained. 

[0021] According to invention of claim 2, it is effective in the ability to raise the resolution and 
the brightness of an image by having made the projection means into plurality. Moreover, since 
amendment whose boundary line when compounding two or more images corresponds was 
applied, even if a view moves somewhat, neither a cubic effect nor a feeling of devotion is 
spoiled. 

[0022] According to invention of claim 3, since the angle of visibility of a screen was made 
comparable as human being's angle of visibility, a cubic effect and a feeling of devotion can be 
raised. 

[0023] Since according to invention of claim 4 stereoscopic vision glasses are equipped with a 
liquid crystal shutter and it was made to carry out remote control of the liquid crystal shutter 
with an emitter vessel, there is an advantage that it is not necessary to restrain a **** experience 
person's view, about a screen. 

[0024] According to invention of claim 5, since the projection means has been arranged at the 
abbreviation equal distance from the core of a spherical-surface-like screen, graphic display 
capacity of two or more projection means can be made into an abbreviation EQC, and 
dispersion in the resolution between two or more images or brightness can be suppressed. 
[0025] According to invention of claim 6, since the image of a wide-field-of-view angle was 
projected on the screen on the spherical surface by once reflecting the image projected by two 
or more projection means in a convex mirror, even if it generally does not use the projector of 
an expensive extensive field angle, it is effective in the virtual environment experience 
equipment of a wide-field-of-view angle being realizable. 

[0026] Since the camera for location detection of an experience person arranges above 
experience equipment, the image photoed with this camera detects an experience person's 
location and the parameter of distortion amendment changed dynamically to an experience 
person's detected location according to invention of claim 7, it is effective in distortion 
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amendment of the always optimal condition being realizable also to the experience person who 
moves. 

[Brief Description of the Drawings] / 

[Drawing 1] It is the block diagram showing the whole equipment configuration of this 
invention. 

[Drawing 2] It is the explanatory view comparing and showing the example of a display by 
conventional equipment and the equipment of this invention. 

[Drawing 3] It is the cross-sectional view showing arrangement of the screen used for the 
equipment of this invention, and a projection means. 

[Drawing 4] It is drawing of longitudinal section showing arrangement of the screen used for 
the equipment of this invention, and a projection means. 

[Drawing 5] It is the explanatory view showing the principle of the distortion amendment means 
used for the equipment of this invention. 

[Drawing 6] It is the top view of one example of invention of claim 6. 
[Drawing 7] It is the elevation of one example of invention of claim 6. 
[Description of Notations] 

1 Screen 

2 Image Creation Means 

3 Distortion Amendment Means 

4 Projection Means 

5 Stereoscopic Vision Glasses 
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